🕷️️ Job Radar • SCRAPING

freelancer.com 🟠 2026-05-28

🔹 Competitor E-commerce Product Intelligence Scraper
👤 Client: 🇮🇳 palvancha, India Member since 2019-04-29
💰 Price: $39 Average bid
🚩 Problem: Need for automated, recurring extraction of full product catalogues and assets from non-standard e-commerce sites for pricing and content analysis.
📦 Existing: Private list of competitor URLs.

Specifications:

[Target] Direct competitor e-commerce stores (non-marketplace)
[Method] Full catalogue crawl, variant attribute extraction, image downloading
[Stack] Python (Scrapy, BeautifulSoup, Selenium, or Playwright)
[Security] Rotating proxies, request throttling, CAPTCHA handling
[Format] CSV, Excel, Compressed image folders (SKU-organized)
[UI/UX] Private Git repository with README documentation

Workflow:

1. Implementation of anti-bot bypass and proxy rotation logic.
2. Development of crawlers for category/sub-category navigation.
3. Extraction of product metadata, pricing, and variant attributes.
4. Automated image downloading and SKU-based filing.
5. Export to structured CSV/Excel files.
6. Setup of scheduling mechanism for weekly updates.